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Abstract. Motivated by the problem of the coexistence on transmission links 
of telecommunication networks of elastic and unresponsive traffic, we study in 
this paper the impact on the busy period of an M/M/l queue of a small per- 
turbation in the server rate. The perturbation depends upon an independent 
stationary process (X(t)) and is quantified by means of a parameter t C 1. 
We specifically compute the two first terms of the power series expansion in 
e of the mean value of the busy period duration. This allows us to study the 
validity of the Reduced Service Rate (RSR) approximation, which consists in 
comparing the perturbed M/M/l queue with the M/M/l queue where the 
service rate is constant and equal to the mean value of the perturbation. For 
the first term of the expansion, the two systems are equivalent. For the second 
term, the situation is more complex and it is shown that the correlations of 
the environment process (X(t)) play a key role. 
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1. Introduction 

We consider in this paper an M/M/l queue with a time varying server rate. We 
specifically assume that the server rate depends upon a random environment repre- 
sented by means of a process (X(t)), taking values in some (discrete or continuous) 
state space and assumed to be stationary. The study of this queueing system is 
motivated by the following engineering problem: Consider a transmission link of a 
telecommunication network carrying clastic traffic, able to adapt to the congestion 
level of the network, and a small proportion of traffic, which is unresponsive to 
congestion. The problem addressed in this paper is to derive quantitative results 
for estimating the influence of unresponsive traffic on elastic traffic. 

In real implementations, elastic traffic is controlled by the so-called transmis- 
sion control protocol (TCP), which has been designed in order to achieve a fair 
bandwidth allocation among sufficiently long flows at bottleneck links. If we as- 
sume that the link under consideration is the bottleneck, say, the access link to 
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the network, then it is reasonable to assume that bandwidth is distributed among 
the different competing elastic flows according to the processor sharing discipline 
(see for instance Massoulie and Roberts ^U] an d Delcoigne et al. Unresponsive 
traffic is then composed of small data transfers, which are too short to adapt to 
the congestion level of the network. Throughout the paper, it will be assumed that 
long flows arrive according to a Poisson process. 

With the above modeling assumptions, unresponsive traffic appears for elastic 
flows as a small perturbation of the available bandwidth. In addition, when there is 
no unresponsive traffic, owing to the inscnsitivity property satisfied by the M/G/l 
processor sharing queue, the number of long flows is identical to the number of 
customers in an M/M/l queue. Hence, in order to obtain a global system able to 
describe the behavior of long flows in the presence of unresponsive traffic, we study 
an M/M/l queue with a time varying server rate, which depends upon unresponsive 
traffic (for instance the number of small flows and their bit rate). The problem 
is then to estimate the impact of unresponsive traffic on the performance of the 
system. A classical issue is in particular to investigate the validity of the so-called 
reduced service rate (RSR) approximation, which states that everything happens 
as if the server rate for long flows were reduced by the mean load of unresponsive 
traffic. RSR approximation results (also called reduced load equivalence) have been 
shown to hold in a large number of queueing systems where some distributions are 
heavy tailed see Agrawal et al. |T], Jelenkovic and Momcilovic [5] for example. 

It is worth noting that queueing systems with time varying server rate have 
been studied in the literature in many different situations. In Nunez-Queija and 
Boxma , the authors consider a queueing system where priority is given to some 
flows driven by Markov Modulated Poisson Processes (MMPP) with finite state 
spaces and the low priority flows share the remaining server capacity according to 
the processor sharing discipline. By assuming that arrivals are Poisson and service 
times are exponentially distributed, the authors solve the system by means of matrix 
analysis methods. Similar models have been investigated in Nunez-Queija [111 I12| 
by still using the quasi-birth and death process associated with the system and a 
matrix analysis. In this setting, the characteristics of the queue at equilibrium are 
expressed in terms of the spectral quantities of some matrices leading to potential 
numerical applications. More recently, priority queueing systems with fast dynam- 
ics, which can be described by means of quasi-birth and death processes, have been 
studied via a perturbation analysis of a Markov chain by Altman et al. |2] ■ Boxma 
and Kurkova 0] studies the tail distributions of an M/M/l queue with two service 
rates. 

Getting qualitative results for queueing systems with variable service rates to 
study, for example, the impact of the variability of the service rate on the perfor- 
mances of the system is rather difficult. At the intuitive level, it is quite well known 
that the variability deteriorates them but, rigorously speaking, only few results are 
available. The main objective of this paper is to get some insight on these phenom- 
ena by considering a slightly perturbed system. As it will be seen, deriving such 
an expansion is already quite technical. 

In this paper, it is assumed that the server rate of the M/M/l queue is equal at 
time t to fx + ep(X(tj) for some function p, where (X(t)) is the process describing 
the environment affecting the service rate. In Fricker et al. TJ. it has been assumed 
that the process (X(t)) is a diffusion process and that p(x) — —x. In this paper, 
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the perturbation function p is quite general and the environment process (X(t)) 
is only assumed to be stationary and Markovian. Moreover, we are specifically 
interested in the power series expansion of mean busy period duration in e, which 
quantifies the magnitude of the perturbation. As far as the first order is concerned, 
the RSR approximation is valid: The time-varying server queue is identical to an 
equivalent M/M/l queue with a fixed service rate equal to the average service rate 
/i + eE[p(X(0))]. Combining the observation with the results obtained in Antuncs 
et al. |nj, one can easily conclude, via a simple regenerative argument, that the RSR 
holds for the mean number of customers in the queue. The analysis of the second 
order is much more intricate; the correlations of the process (X(t)) play a key role 
and, consequently, the RSR approximation is no more valid. 

The organization of this paper is as follows: The model is described in Sectional 
The first order term in the power series expansion of the mean busy period du- 
ration is computed in Section [3] The second order term is derived in Section 0] 
Applications of the results are discussed in Section [SJ Some basic elements of the 
M/M/l queue arc recalled in Appendix. 

2. Model 

2.1. Notation and Assumptions. Throughout the paper L(t) denotes the num- 
ber of customers at time t in an M/M/l queue with arrival rate A and service 
rate /i. The variable B denotes the duration of a busy period starting with one 
customer: Given L(0) = 1, 

B = inf{s > : L(s) = 0}. 

It is assumed that the stability condition A < /i holds. The invariant distribution of 
(L(t)) is geometrically distributed with parameter p = X/ /i. For x > 1, the variable 
B x denotes the duration of a busy period starting with x customers. By definition, 

Bi d =' B. By convention, in the following when the variables B, B\ and B[ are 
used in the same expression, they are assumed to be independent with the same 
distribution as B. This queue will be referred to as the standard queue denoted, 
for short, by S- Queue. 

For £ > 0, A/g denotes a Poisson process with intensity £ and for < a < 
b, Af^([a, b]) denotes the number of points of this point process in the interval 
[a, b]. In particular, A/a will represent the arrival process and J\f^ the process of the 
services of the S-Queue. The Poisson processes Af\ and A/" M will be assumed to be 
independent one of each other and independent of the modulating Markov process 
(X(t)). The process (L(t)) can be represented as the solution of the stochastic 
differential equation 

dL{t) d = L{t) - L{t-) = Mx{[t, t + dt]) - l {i(t _)> }A7i([*, * + di\) 

(1) = dNx(i) - l {L (t-)>o}dAf^t), 

where Lit—) is the left limit of L(s) at s ft. For the representation of queueing 
Markov processes as solutions of stochastic differential equations, see Robert [H| . 

The perturbed queue. In the following, we consider an M/M/l queue with a 
service rate varying in time as a function of some process (X(t)) taking values 
in some space, denoted by S. We assume that the process (X(t)) is an ergodic 
Markov process on S. Typically, the state space of the environment S is a finite 
or countable set when (X(t)) is a Markov Modulated Poisson Process (MMPP) or 
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S = M in the case of a diffusion, for instance an Ornstein-Uhlenbeck process (see 
Fricker et al. 0). The invariant measure of the process (X(t)) is denoted by v. The 
Markovian notation E x (-) will refer only to the initial state x of the Markov process 
(X(t)), therefore E„(-) will denote the expected value when the process (X(t)) is 
at equilibrium. 

The variable L e (t) denotes the number of customers at time t in the M/M/l 
queue with time- varying service rate. The process (L e (t),X(t)) is a Markov process. 
The transitions of the process (L £ (t)) are given by: If L £ (t) = I and X(t) = x at 
time t, 




I + 1 at rate A 

l-l " (p + e P (x))l {l>0} 



for some function p(x) on the state space of the environment S and some small 
parameter e > 0. When p(x) > 0, this implies that there is an additional capacity 
of service when compared to the S-Queue. On the contrary when p(x) < 0, the 
server is with a slower rate than in the S-Queue. The quantity p + (a) (respectively 
p~(a)) is defined as max(p(a),0) (respectively max(0, — p(a))). At time t > 0, the 
additional capacity is therefore ep + (X(t)) and —ep~(X(t)) is the lost capacity. The 
perturbation considered in this paper is regular, see Altman et al. [2]. 

The variable B £ is the duration of a busy period starting with one customer, 
that is, given L e (Q) = 1, 

B e = mi{s > : L E (s) = 0}. 

For x > 1, the variable B x denotes the duration of a busy period starting with 

x customers (Bf d =' B e ). In the rest of this paper, we make the two following 
assumptions: 

(Hi) the function \p(x)\ is bounded by a constant M > 

(H 2 ) esup{\p(x)\ : x £ S} < fi. 

The following proposition establishes that the length of the busy cycle is indeed 
integrable. The rest of the paper is devoted to the expansion of its expected value 
with respect to e. 

Proposition 1. Under the condition A < fi, there exist some constants K and 
£o > such that for any e < €q and n > 1, 

supE(i^ \X(Q) =x) < Kn. 

Proof. If one chooses £o so that 

Mo d = M — £ o inf{p~(£) : x £ S} > A, 

then clearly the number of customers of the P-Qucuc is certainly smaller than the 
number of customers of an M/M/l queue with arrival rate A and service rate 
Consequently, the corresponding busy periods compare in the same way, hence it 
is enough to take K — l/(/io — A). □ 

The queue with time-varying service rate as defined above will be referred to as 
the perturbed queue, denoted, for short, by P-Queuc. The case e = obviously 
corresponds to the S-Queue. 
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2.2. Adding and Canceling Departures. The basic idea of the perturbation 
analysis carried out in this paper is to construct a coupling of the busy periods of 
the processes (L(t)) and (L £ (t)). This is done as follows, provided that for both 
queues the arrival process is Af\. 

Additional departures. We denote by Af + the non-homogeneous Poisson process 
whose intensity is given by t — > sp + (X(t)). Conditionally on (X(t)), the number 
of points of Af + in the interval [a, b], < a < b is Poisson with parameter 

e f p+(X(s))ds. 

J a 

The points of A/" + are denoted by < < t \ < . . . < i+ < . . . and are called 
additional departures. In particular the distribution of the location t\ of the first 
point of Af + after is given by, for x > 0, 

(2) P(t+ > x) = F{Af + {[0,x}) = 0) =E (^exp (s J p+(X{s))ds 

See Grandell jS] for an account on non-homogeneous Poisson processes, referred to 
as doubly stochastic Poisson processes. 

Canceling Departures. We denote by Af~ the point process obtained by thinning 
the point process A/" M (see Robert Ql]). It is defined as follows: A point at s > 
of the Poisson process A/"^ is a point of M~ with probability ep~ (X(s))/ fi. In this 
way, Af~ is a stationary point process with intensity ep~ (X (s)) . A point of A/"~ is 
called a canceled departure. The points of the point process M~ are denoted by 
< < fcf < . . . < i~ < . . .. For x > 0, by definition, 




where (sj) are the points of the point process Af^. 

With the above notation, it is not difficult to show that the Markov process 
(L £ (t)) has the same distribution as the solution of the stochastic differential equa- 
tion 

(4) dl £ {t) = dM x (t) - l {Ze(t _ )>0} d(A/- M +AA+ - Af-) (i), 

which is the analogue of Equation Q for the P-Queue. 

3. Busy period analysis: First order term 

Let us assume that a busy period with one customer starts at time in the 
S-Queue and P-Queue. In this section, we determine the first term of the power 
series expansion in e of the expected value of B e , the duration of the busy period in 
the P-Queue. This derivation allows us in addition to lay down part of the material 
needed in the next section to compute the more intricate second term of the power 
series expansion in e. 

For the first order term, we only have to consider the cases when there is either 
a single additional departure or else a single canceled departure. The probability 
that both events occur in the same busy period is clearly of the order of magnitude 
of e 2 since the intensities of the associated Poisson processes are proportional to e. 
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For x > 1, the stability assumptions ensure that the expected values of the busy 
periods starting with x customers, namely ¥.(B X ) and E(i^), are both finite. When 
the first additional and canceled departures are such that t^ > B e and t^ > B e 
then B = B e . We now consider the different possibilities. 

A single additional departure. If there is only one additional departure and no 
canceled departure in (0, B £ ) then at time B e , the P-queue is empty and the S- 
queue is with one customer (see Figure 

P-Queue 

S-Qucuc 



t+ B e B 



Figure 1 . A busy Period with an Additional Departure 

We specifically prove the following lemma. 
Lemma 2. In the case of a single departure, we have 



(5) 



E [(B-B £ )t, 



E4p(X(0))+} 
S ; rTo h o e 



W<B}J " ( M -A) 2 

where v is the equilibrium distribution of the environment (X(t)). 

Proof. When there is only one additional departure, the variable B £ is between 
and t^. We can write 

(6) E ((B - B £ n { tt<B}) = E {( B - B e )l {tt< Bc <t i:t->Bt } ) + A - 
where the offset term A can be bounded as follows 

(7) A < E (\B B £ \ (l {ta+< s. )tl ->fl. } + l {t -<Bs^<B. } )) ■ 

Let us estimate the first term of the right-hand side of ©■ Equation (J2J and 
the boundedness of p give that 



< B) = 1 -E ^exp P + (^(s))ds ] j^j 




p+{X(s))ds +o(s) 



= eE(B)E„ \p + (X(0))] +o(e) = -E„ [p + (X(0))] + o(e), 

fi — A 

by independence between B and (X(t)) and the stationarity of (X(t)). By the 
strong Markov property at the stopping time B £ , conditionally on the event {t^ < 
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B e < t~2, B £ < ti}, the S-Queue starts at B £ an independent busy period with one 
customer, therefore 



E [(B B £ )l {tt< ^ E<tt t - >i}c} j = P(t+ <B £ < 4,t- > B £ ) 

x E ((B — B e ) \tt <B E < t£,ti > B e ^j = F(tf <B e < tf,t^ > B £ )E(Bi). 

Now, since {tf < B e } = {t+ < B} on the event {t+ < B e < t+,B E < t~], then 
F(t+ <B £ < t+, t\ > B £ ) = F(t+ <B)- F(t+ < B e , t+ < B 6 )- 

F(t+ < B E , *i < B E ) + P(i+ < B e , t+ < B e , t+ < B E ) 
= F(t+ < B)+o{e), 

since two or more extra jumps in the same busy period is o(s). Similarly, by using 
again the strong Markov property, one gets the following estimation 



l {t+<B',t 1 >B C } 



< £)E(B B )P(t+ <B E < t+ +1 ,q > B E ) 



n>2 



< 



(/i - A) 



5>P(A/-+([0,5]) 



Indeed, given the S-Queue, 7V + ([0, B]) has a Poisson distribution with parameter 
Jo £P + {X{s))ds ) which implies that 

^nP(7V + ([0,B]) = n) = 



E 



sp + (X(s))dsj - E (j a 



ep' {X{u))due~ £ ^ B r> + (Ms))ds = Q ^ 



and the first term in the right hand side of Inequality is thus negligible at the 
first order in s. 

To estimate the second term in the right hand side of Inequality Q , we need to 
consider the different possibilities for the location of the points tf and t^. In the 
case that an d t\ occur during [0, B] and B e > B, at time B the P-Queue has 
at most p > customers if there have been p + 1 canceled departures. If T>([0, B]) 
is the number of customers during the busy period of the S-Queue, then certainly 



E 



B) ^-{B'>B,t~<B,t + <B} 



< E (E X(B) {B V{%B]) )) F(t- <B,t+ <B< t+) 

< KE (P([0, B})) P(tf < B,4 < B <4) = o(e), 
by Proposition n On the other hand, 



E 



B £ - B 



<B,t± <B,tf <B} ) 



<B,tJ<B} 



o(e). 



Finally, 



E 



B £ — B 



^-{t-<Bz,t+<B'} 



< E 



B 6 - B 



{ti<B,t+<B} 



E Bl 



{ti<B,B<tJ<B e } 



s 
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where it can be shown in a similar way as before that the last term is o(e). One 
concludes that the term A is o(e) as e goes to 0. By using Equation ©, we obtain 
the desired result. □ 

The estimation of the right hand side of Equation (jSJ may appear quite cum- 
bersome. It is however worth noting that the environment (X(t)) of the P-Queue 
introduces delicate dependences, which have to be handled with care. This is why 
we have chosen to explicitly write the precise setting in which the strong Markov 
property is used to get the first order term. In the following, similar arguments will 
not be explicitly formulated. 

A single canceled departure. Suppose now that there is only one canceled departure, 
i.e. a departure of the S-Queue is canceled for the P-Queue, and no additional jumps 
during the busy period of the S-Queue. In this case, at the end of the busy period 
of the S-Queue, at time B, the P-queue has one customer and thus starts a busy 
period. Provided that there are no more canceled and additional departures during 
(B, B £ ) in the P-Queue then the difference between both busy periods has the same 
distribution as the length B\ of a standard busy period. See Figure El 



P-Queue 
S-Queue 



B 



Figure 2. A Busy Period with a Canceled Departure 



Lemma 3. In the case of a single canceled departure, we have 
(8) E y(B - B)l {t -< B} ) = e (/i _ A)2 + o(e). 

Proof. By using the same arguments as before, one obtains the relation 

E((5 e -B)l {t -< fl} ) =E(B 1 l {t -< B>fl+Bi<mln(t + )t - )} ) +o(e) 
= E(£i)P(^ < B) + o(s). 

To estimate P(ij~ < B), denote by (Di) the sequence of departures times in the 
5-Queue and N the number of customers served during the busy period of length 
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B, then Equation J3J gives the identity 



i=l ^ } = 1 V ^ 



£ 



J^ p -(j:(a))J +o(e) 

= -E(iV)E(p-(X(Di))) +o(e) 
A 1 

by stationarity of (X(t)) and Wald's Formula. Since K(N) = — A) (see Ap- 
pendix), Equation (JHJ follows. □ 

In the expansion of the busy period of the P-Queue, the term in s is given by the 
two events consisting in only one canceled or only one additional departure during 
the busy period of the S-queue. The next proposition follows from Equations (0 
and ijHJ). 

Proposition 4 (First Order Expansion). 

w E ( g.,= ' ,™p + o(£) . 

fj,-X {n - A) 2 

Equation © is consistent with the so-called Reduced Service Rate approxima- 
tion. As a matter of fact, everything happens as if we had a classical M/M/l 
queue with service rate \x + eE„[p(A(0))] and arrival rate A. In that queue, the 
mean length of the busy period is given by 

i i E„[p(ir(o))] 



M + eE„[p(.X-(0))]-A At -A (;u - A) 2 

which coincides with Equation (J5J. In the following section, we investigate the 
second order term and show that the RSR approximation is no more valid. 

4. Busy Period: Second order term 

In this section, the coefficient of e 2 of the mean busy period K(B £ ) is calculated. 
In the same way as for the first order, this coefficient is related to the event that two 
extra jumps occur during a busy period of the perturbed M/M/l queue. Since extra 
jumps can be either additional departures or canceled departures, there are three 
cases to investigate. As it will be seen, this coefficient stresses the importance of 
the evolution of the varying capacity, in particular through its correlation function. 
This was not the case for the first order term, since only the average value of the 
capacity shows up there. 

In the following, in order to get the e 2 coefficient, one has to consider the different 
possibilities for the location of the points , t% and t% ■ By using similar 
arguments as in Section it is not difficult to show that any event involving or 

yields a term of the order e 3 in the expansion of K(B £ — B). 

Define 

A+ = {tf <B,t^>tf +B L{tt) _ x }. 

On this event, at least one departure is added and the busy period of the P-Queue 
finishes before a departure is canceled (note that B L ^ t +^_ 1 is the length of a busy 
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period of S-Queue starting at time ti with L(ti) — 1 customers). On the event 

A± = {q < B, B < t+ < B + B ± }, 

a canceled departure occurs and another departure is added before the completion 
of the busy period of the P-queue, where B\ denotes the duration of the additional 
busy period due to the canceled departure. Finally, on the event 

A- = {tr <B,B + Bi< ti}, 

at least a canceled departure occurs and no additional departures are added before 
the completion of the busy period B\ . 

By checking all the different cases, it is not difficult to see that if A — A+ UA± U 
A-, the expression E((B e — B)!^) is o(e 2 ) (and even equal to in some cases, 
for instance when there are a canceled departure and an additional departure in 
such a way that B £ = B). The following sections are devoted to the estimation of 
E((B e - B)1 A ) for A e {A+,A±,A-}. 

In a first step, we analyze the case when there are only additional departures be- 
fore B, that is, we consider the term E((B £ — B)t A+ ). When no canceled departure 
occurs, at most two additional departures in the time interval [0,£>], occurring at 
times t{ and t£ respectively, may play a role in the computation of the coefficient 
of e 2 of M(B — B £ ). In this case, the difference between B — B e is equal to the busy 
period of an S-Queue which starts with either one or two customers, depending on 
the fact that, on the event {ti < B}, the busy period of the P-Queue is already 
completed at time t\ or not. See Figure 

As before, Bi denotes a random variable with the same distribution as the sum 
of two independent variables distributed as B\ and independent of B, t± and t£ ■ 
One gets 



- B*)l A+ ) = E y(B — B £ )l {tHB t -> tt+BL ^_ i} ^ 
= E (B 2 ) P (t+ < B, t+ <t+ + B Htt) _ v ti >t++ B L(tt) _ h 
+ E (Bi) P (t+ <B,t+>t+ + B i(t +)_ ls *r >4+ B L(t + M ) + o(e 2 ). 
This decomposition entails that 

(10) E ((B - B £ )1 A+ ) = (E (B 2 ) - E (B,)) P (t+ < B, t+ < t+ + B L{tt) _^j 

+ E(Bi) (v(t+ < B) -v(t+ < B,t- < ^ + B i(t + ) _ 1 )) +o(e 2 ). 

From Equation (|10|) . one has to expand three expressions with respect to e. This 
is done by proving the three following lemmas. 



Lemma 5. The quantity P ytj < B,i% < tj + B L ^ t +^_ 1 j can be expanded as 

(11) p(t+ <b,4 <4 + B L(tt) _^ 



pe 2 E [[ (B- v)E v (p+(X(0))p+(X(v))) ) dv + o{e 2 ). 
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P-Queue 
S-Queue 



1 








D 



Figure 3. Two Additional Departures 



Proof. Let us recall the regenerative description of a busy period starting at time 
with one customer: At time E\ (exponentially distributed with parameter A + /i), 
with probability /i/(A + /i) the busy period is finished. Otherwise, with probability 
A/ (A + n), a new customer arrives and a sub-busy period of duration B\ (with the 
same distribution as B\ ) begins until the number of customers reaches 1 again. In 
this way, the variable B can be represented as follows 



where H is geometrically distributed with parameter A/(A + /i), (Ei) are i.i.d ex- 
ponentially distributed with parameter A + /i and (B\) are i.i.d. All these random 
variables are independent. For < i < H , 

- Si denotes the end of the zth sub-busy cycle: sq — and, for i > 1, 
Si = Si _i + Ei +B\,B = s H + E ; 

- Ni denotes the number of arrivals during the ith sub-busy cycle; 

- Si~i + D\, . . . , Si~i+D l N . are the instants of departures of customers during 
the ith sub-busy cycle. 

For the joint distribution of the vector (Ni, D\, . . . , D l N ), see the Appendix. Fig- 
ure 0] gives an illustration of the above definitions. 



H 



(12) 




i=i 



1 



sa=0 Ei 



SH 



B 



Figure 4. Decomposition of a Busy Period 
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It is easy to see that for the event {tf < B , t% < ^1 + B L ^ t +^_ 1 } to occur, tf and 

i% have to be in the same sub-busy period, [sj_i + Ei, Sj], for some i £ {1, . . . , H}. 
For a fixed z, the probability that the first two additional jumps are in the ith 
sub-busy period, is 

= e 2 E( f ' P + (X(u)) f ' p + (X(s))dsdu ) +o(e 2 ). 

Since, B\ — s^— s;_i — Ei—± has the same distribution as B and by the stationarity 
of ((X(t)), the coefficient of e 2 can be expressed as follows, 

\J0<u<v<B 



E ( / E„ [p + (AT(0))p + (X(v - u))] dudv 

\Jo<u<v<B 



Finally, since H is geometrically distributed with parameter A/(A + /i), Equation 
(TTJ follows. □ 

We turn now to the expansion of the quantity P(tf < B), which is of course a 
refinement of what has been done in Section 13 

Lemma 6. The quantity P(f^~ < B) can be expanded as 
K v \p+(X(0))] 



(13) F(t+<B)=e- 



fj, — X 

£ 2 E ( f [B — v) E„ (p+(X(0))p+{X{v))) do] + o(e 2 ). 



Proof. We clearly have 

<B)=e(1- e -cJa P + (X(s))ds 



b \ 2N 







The second moment of the integral can be expressed as follows, by symmetry, 



b \ 2N 



E [ | / p + (X(s))ds\ = 2E / p + {X(u))p + {X{v))dudv 

'o J j \JQ<u<v<B 

= 2E ( f E u (p + (X(0))p+(X(v - u))) dudv 

\J0<u<v<B 

by stationarity of the process (X(t)) and Equation (|13|l follows. □ 

Finally, we examine the expansion of P(if < B,t^ <tf + B L ^ t +^_ 1 ). This term 
is more delicate to expand, because of the canceled departure. 
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(.4)- 



Lemma 7. The quantity P(tf < B,t 1 < + B i / i tu 1 ) can be expanded as 



(14) F(tt<B,ti<tt + B L[t + ) _ 1 ) 

,2 ( H Ni . Ai \ 

" E EE / P + (X(u))p-(X(D)))du + o(e 2 ), 



£ 



where H is geometric distributed with parameter A/(/i+A), [Ni, D\, . . . D l N ) denotes 
the number of departures and the departures times in a busy period of length B l , 
and 

H 

A i = B\ + E Q + ( E k+ B i)> 

k=i+l 

where [Ei) are i.i.d is exponentially distributed with parameter [i + X and (B\) are 
i.i.d with the same distribution as B. 

Proof. Using the regenerative description of a standard busy period introduced in 
the proof of Lemma^l the variable t^ has to occur in some sub-busy period [sj_i + 
Ei, Si] of B for some 1 < i < H. A little thought show that if t± S [s.;-i + Ei, Sj] 
then tf has to be in [sj_i + Ei,B] for the event {t^ < B,t± < t^ + ■B i ^+^_ 1 } to 

occur. The probability that t\ and t\ are located in [si-i+Ei, Si] and [si-i+Ei, B], 
respectively, is 



/ r B Ni 

E / ep + (X(u))e- e tt v+{x{s))ds du*Ye 



p-(X(«,_i + D))) 



'si-i+B, j=1 A* 

fe=l ^ " ' i=l r=l ^ " 

where the coefficient of e 2 is 



;■(§/: 



p+(X(u))p-(X(s i _ 1 +£»}))^ 



Considering the different sub-cycles during B and by the stationarity of (X(t)), 
Equation (JTU) follows. □ 

We are now able to compute the coefficient of e 2 in the power series expansion 
of E((B e - B)1 A+ ) in e. 

Proposition 8. The coefficient of e 2 in the expansion of K((B — B £ )\ A+ ) with 
respect to e > is given by 

(15) a+ = --e( [ (B-v)E v (p + [X(0))p + (X[v))) dv) 

) du 



V Wo 



^ E (EE{ \ + (X(u))p-(X(D J )) l 



i=i j=i 
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To complete the analysis, we now turn to the expansion of E((B £ — B)1 A± ) and 
E((B £ — B)1 A _). In the calculations, it appears more convenient to consider the 
sum of both terms and we then have the following result. 

Proposition 9. The coefficient of e 2 in the expansion o/E((B e — B)t^ ±u ^_ ) with 
respect to e > is given by 

1 ( ( N r B+Bi \ 

(16) a ~ = f(l-p) [ ■ [J^J p-{Xm)P + {X{s))ds\ 

+ 7J E (jt fy-(X(0))p-(X(B A + D' k ))\ j , 

where (N, D\, . . . , Dn) and (N', D[, . . . , D' N> ) denote the number of departures and 
the departure times in the busy periods of length B and B\ , respectively. 

Proof. When a single canceled departure occurs (at time t±) before B, an addi- 
tional busy period of length B\ has to be added to take into account the canceled 
departure. 

By the strong Markov property, with the same method as in Section El one 
obtains the relation 



E \{B +B t - B e )l [t -< B , B < t +< B+Bl}j 

= E (B{) P (tf < B, B < tf < B + A) + o(e 2 ), 

where the random variable B[ has the same distribution as the random variable 
B\, hence, 



(17) E [{B £ B)1 A± ) = E [(B £ B)l {t -< B B < tUB+Bih 
= E (Bil {tr < Bi B<ti<B +Bl} ) - E ( B 'i) F <B,B<t+ <B + B 1 )+ o(e 2 ). 



Now, two canceled departures in the same busy period gives two additional 
independent busy periods starting with one customer, 



(V - B)1 A _) = E ((B £ £)%< B , B+Sl < t + } ) 



— E ( Bll r.- <R H -l-H,<TniTlf*+.tr1 



{*~<B, B + Bi<min(t+,t~)} y 
(Bi + B ± ) l| t - < B B < 4 - <B+B lt B+Bi+B[<t^} 

+ E ( B ^{ t -<B,t-<B,B+B 1 +Bi<t+}) + °( £2 )- 



Hence, 

E [(B £ - B)1 A J) = E (Sil {tr < B>t - >s+Sl} ) - E (Sil {tr <fl,t+< B+fli: 



E ^ll{t^<S,B<i-<B+Bi} J +E(B 1 )E (^l{ t -<B, S < t -< B+Bl ] 

+ E(s 2 l {t -< B} ) +o(^ 2 ). 
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Finally, 

(18) B)1 A .) =E(Bi)P(tr <B,q >B) -E(Bil {ti -< S!i +< B+Bl} ) 

+ E (B[) P (t^ < B, B <q < B + Si) + 2E (Si) P (ij < B) + o(e 2 ), 

From Section |21 it is not difficult to see that the expression 

P (*r < B,q > B) + 2P (tj < B) 

has no term in e 2 in its power series expansion. Thus the first term and the last 
term of the right hand side of Equation l|18|l cancel out for the expansion. 
The following expansions are obtained in a similar way, 



( 



Bl~to-{t-<B,tt<B+Bi} 



2 ( N rB+B 1 

-E LBiV/ p~(X(D, 



))p + (X(s))ds)+o(e 2 ), 



and 



(t^ <B,B<t^<B + Bi) 

_ 2 ( N N' 



£ 



/// 



^2^2p-(X(0))p-(X(B-D i+ D' k )) + o(e 2 



i=i k=i 



where (N, D\, . . . , Dm) and (N\ D[, . . . , -D^') denote the number of departures 
and the departures times in two independent busy periods of lengths B and B±, 
respectively. 

If we sum up the expansions obtained for canceled departures and one canceled 
and one additional departures (Equations (|17(l and p8|l). with standard manipu- 
lations, one gets the second term of the expansion K((B e — B)(t A± + 1a~)) in 

E. ~ ' ' ' □ 

To summarize the results obtained in this section, we can state the following 
theorem. 

Theorem 10. The coefficient of s 2 is the power series expansion ofE(B £ — B) in 
e is equal to a_ — a+, where the coefficients a + and a_ are given by Equations i|15|) 
and l|16fl . respectively. 

It should be noted that the distributions involved in Equations B15J1 and l|16|l 
can be explicited by using the classical results concerning the M/M/l queue. See 
the Appendix where they are recalled. In the next section, we examine some ap- 
plications of the above result. 

5. Applications 

5.1. Non-Negative Perturbation Functions. Equations 111|) and (|13fl give that 
the expansion 



(b - B e ) = Sis + S 2 e 2 + o(e 2 ) 
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holds, with <Si = E„ (p(X(0)))/(/z - A) 2 and 

5 2 = -^E ^jf (B - v) E u ( P (X(0))p(X(v))) dv^ . 

Denote by C p (u) = E v [p{X (0))p{X (u))} - E v [p(X(Q))} 2 , the covariance of the 
extra capacity. The second term of the expansion can be expressed as 

* 2 = -Ie(/V^)^ e ^™ 2 



hence, 

E ( B - B e ) =e 



M Wo V ' PK ' y (/^-A) 3 



E„ b(X(0))] j E„ b(X(0))] 2 



(p A) 2 (/x - A)3 

* -E ( / (B - u)Cp(u) ) + o(e 2 ). 



The following proposition which readily follows, compares the length of the busy 
period of the P-Queue with an M/M/l queue with service rate /x + eE ll (p(X(Q))). 

Proposition 11 (Comparison with reduced service rate). If B is the length of a 
busy period of an M/M/l queue with service rate pi + eE u (p(X(0))) then 

lim -^E (S - B e ^j = -ifi (j (B - v) C p [v) dv J , 



where, for u > 0, 



C p (u) = E v [p(X(0))p(X(u))} - E„ [p(X(0))} 2 



is, up to the factor e 2 , the covariance function of the extra- capacity of the perturbed 
queue. 

It is straightforward to conclude from the expression in Proposition 1111 that 
E(B — B e ) is negative when e is small. 

Corollary 12 (Negative impact of the variation of the service rate). When the 
environment is positively correlated i.e. when the function u — > C p {u) is non- 
negative, then the first term of the expansion ofE(B — B £ ) in e is of order 2 and 
is negative. 

The following expression gives a closed form expression of the second term of the 
expansion when the environment has an exponential decay. 

Proposition 13. When the correlation function of the environment is exponentially 
decreasing, i.e. when, for some a > 0, 

C p (x) = Var[ppf(0))] e' ax , x>0, 

then the difference between reduced and variable service rates satisfies the relation 

(19) i»Ie(b-»-) S 4l( „) = -MW!E n < , 
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where, Z is the random variable whose density function on R+ is given by 

1 f +QO 
x -» — / P (B > u) du. 

m(i- p) Jx 

In particular, the function a — > A2(a) is non- decreasing and concave. 

Proof. For a square integrable random variable A on M + , A* denotes the random 
variable with density x — » P(A > u)/E(A) on R + . Note that for a > 0, 

and E(A*) = E(A 2 )/(2E(A)). 

To simplify notations, it is assumed that Var[p(X(0))] = 1. Propositionll II gives 
that the coefficient A-2(a) of e 2 is in this case 

A 2 (a) ■■ 





7 s , 












f B 












The Proposition is proved by using Relation H2U|) . □ 

5.2. Non-Positive Perturbation Functions. It is assumed in this section that 
the perturbation function is non-positive so that the environment uses a part of 
the capacity of the M/M/l queue with constant service rate [i. This application 
is motivated by the following practical situation: Coming back to the coexistence 
of elastic and streaming traffic in the Internet, assume that priority is given to 
streaming traffic in a buffer of a router. The bandwidth available for non-priority 
traffic is the transmission link reduced by the bit rate of streaming traffic. Denoting 
by ed(Xt) the bit rate of streaming traffic at time t (for instance e may represent 
the peak rate of a streaming flow and d(X t ) the number of such flows active at 
time t), the service rate available for non-priority traffic is fx — sd(x). Setting 
p(x) = —d(x), the function p(x) is non-positive. We are then in the framework 
when the environment gives a reduced bandwidth to a non- priority M/M/l queue. 
The same notation as in the previous section is used extensively. 
Equations J5J and (|f 6fl give that the expansion 



[B-B £ j = Sie + 5 2 e 2 + o(e 2 ) 

holds, with 5x=E [p(X(0))]/()Li - A) 2 and 

/ N N> 

where, as in (|f fijl . (N, Di, . . . , Dn) and (N' , D[, . . . , D' N ,) denote the number of 
departures and the departure times in the busy periods of length B and B\ , respec- 
tively. The terms b\ and 82 are non-positive. Thus, at the first order, the mean of 
B e is larger than the mean of B. The following proposition which readily follows, 
compares the length of the busy-period of the P-Queue with the mean of the length 
of the busy-period B in an M/M/l queue with service rate /1 + eM v \p(X(Q))]. 
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Proposition 14 (Comparison with reduced service rate). If B is the length of a 
busy period of an M/M/l queue with service rate /x + dE„[p(X(0))] then 

1 1 / N N' \ 

(21) to ? E (3 -3") =-____£ \^^C p (X(B-D i + D' k ))\ , 

where, as in Equation l|l(j|) . {N, D\, . . . , Djv) ar i^ {N' , D'i, . . . , D' N /) denote the 
number of departures and the departure times in the busy periods of length B and 
B\, respectively and for u > 0, 

C p (u) = E„ \p(X(0))p(X(u))} - E v [ P (X(0) f 

is, up to the factor e 2 , the covariance function of the capacity of the perturbed queue. 

This result implies that, as for a non- negative perturbation function, the vari- 
ation of the service rate has a negative impact on the performance of the system. 
The following result holds. 

Proposition 15 (Negative impact of the variation of the service rate). When the 
environment is positively correlated (when the function u — > C p (u) is non-negative) , 

then the first term of the expansion o/E (^B — B e ^j in e is of order 2 and negative. 

Comparing to the case of a non-negative perturbation function, if the correlation 
function of the environment is exponentially decreasing, a simple close expression 
for the right hand side member of Equation (|21|) seems to be difficult to obtain, 
though the same qualitative results hold. 

Proposition 16 (Exponential decay). When the correlation function of the envi- 
ronment is exponentially decreasing, i.e. when 

C p (x) = Var[p(X(0))] e~ ax , x>0, 

and some a > 0, the function 

a lim i E (§ - B e \ 

is non-positive, non- decreasing and concave. Moreover when a tends to infinity, 
this quantity converges to zero. 

5.3. Fast Environments. A general perturbation function p is considered to- 
gether with some stationary Markov process (X(t)) with invariant probability dis- 
tribution v. It is assumed that it verifies a mixing condition such as 

(22) lim \E„[f(X(0))g(X(t))} - E v [f(X(0))]E„[g(X(0))}\ = 0, 

t— > + oo 

for any Borelian bounded functions / and g on the state space S. Note that this 
condition is not restrictive in general since it is true for any ergodic Markov process 
with a countable (or finite) state space or for any ergodic diffusion on W 1 , d > 1. 

In this section, the environment is accelerated by a factor a > 0, described by 
the process (X(at)). The behavior when a goes to infinity is investigated. Note 
that when a goes to 0, the environment is frozen: the service rate remains constant 
and equal to fi + ep(X(0)). Such a situation has also been analyzed by Delcoigne 
et al. [H| through stochastic bounds. 
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At the intuitive level, when a gets large, for t and h > the total service capacity 
available during t and t + h is given by 

pt+h -t pah 

uh + e / p(X(au)) du d = ' ph + e- / p(X(u)) du ~ (a + eEJp(X(0))))h 
Jt a Jo 

by the ergodic Theorem. Thus, speeding up the environment averages the capacity 

of the variable queue. This intuitive picture is rigorously established in the following 

proposition. 

Proposition 17. When the environment is given by (X(at)) and Equation <|22|) 
holds then if 62(a) is the s 2 coefficient of the expansion of with respect to e, 

(p - A) 2 

the following relation holds, 

E v ( P (X(0))) 2 
lim 62(a) = ^ . 

Proof. The quantity 62(a) is equal to a_ — a + where a_ and a+ are given by 
Equations (|TrJ|) and , respectively. We shall deal only with the first term of a_ 
in Equation Ijlbj) . Let 



\i=l J o 



F(a) d = -El)'/ 



where iV is the number of customers in the busy period of length B and their 
departure times are denoted by (D i} 1 < i < N). We have 

/ N B+Bi \ 

F(a) = -E \J2 J E(p-(X(aD i ))p + (X(as)) \ B,N) dsj . 

Relation (|22|) and the boundedness of p (Assumption (Hi)) show that, almost surely, 
lim E (p-(X( a D l ))p + (X(as)) \ B,N) = E v (p~(X(0))) E v (p + (X(0))) , 

therefore Lebesgue's theorem gives 

-F(a) 

lim — ; — ; rrrr =E(NB)+E(Bi)E(N) 

a^+o O E u ( J) -(X(0)))E u ( P +(X(0))) v ' v 1; v ; 

1+p 1 1 2 



/i(l-p)3 M -Al-p /i(l-p) 3 ' 

by using the expressions of E(N) and E(NB) in the Appendix. Similar calculations 
can be conducted for all the other terms to finally give the Proposition. □ 

6. Appendix: Some useful quantities for the M/M/l queue 

Let (Ak) (resp. (Dk)) denotes the arrival times (resp. departure times) in a busy 
period of an M/M/l queue with arrival rate A and service rate p. A busy period 
denoted by B that starts at time will last a time t and will consist of N services 
if, and only if, 

(i) there are (N — 1) arrivals in (0,t); 

(ii) D N = t; 

(iii) A k+l !),.!,■ 1 V !. 
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If conditions (i) and (ii) are satisfied then (A2, ■ ■ ■ , Am) and {Di, ■ ■ ■ , Dn-i) are 
independent and represent the ordered values of two sets of N — 1 uniform (0, t) 
random variables. Hence, 

b n (t) = dP(B <t,N = n)/dt = [M) Me w 

[n — 1)1 [n — 1)\ 

xF(A 2 <D U ..., A n <D n -i). 
The first two moments of the stationary busy period are given by 

E(B 1 ) = -J— , E(B 2 ) 1 



Expression (2.40) p. 190 of Cohen |5J shows that 

+00 



71=1 

is given by 



<p(z,$ = J2z n e-^b n (t)dt, 
1 Jo 



= ^ (l + P + - ^(l + P + P^iY-^pz 



for \z\ < 1, SR(£) > 0. It is easy to derive 



1-p 



E 



E(N) = / dty^nb n (t) 
J ° n=l 

E(NB) = / *dtX)n6n(<) ^ "T^ 1 . ) = n ,3 ^ 
Jo £rj Ml 1 - P) 

* (" - 1)] = I dt^n(n - l) Mt ) = -^(1,0) = ^A_. 



To conclude one has to compute E(D) where D — D\ + D2 + ■ ■ ■ + Dm . By 
using the classical branching argument for the busy-period of the M/M/l queue 
(see Robert [HJ for example), one gets 




where a is the service time of the first customer of the busy-period, N a the number 
of arrivals in the interval [0, a], Bi the busy-period generated by the zth customer 
arrived during a, Ni the number of customers in Bi, Di the sum of the departure 
times of Bi from the beginning of this busy-period. Taking the expectation, it is 
easy to derive that 

E(D) = E(fj) + E(aN a ) + E(B)E(N <7 (N ry - 1)/2)E(JV) +E(aN a )E(D), 

where N a has a geometric distribution with parameter A/(A + p). Thus 

E{N a {N a - I)) = 2p 2 . 

Simple algebra gives E(D) = p 2 /{p — A) 3 . 
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